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4 Abstract. A cloud frequency of occurrence matrix is generated using merged 

5 cloud vertical profile derived from Cloud-Aerosol Lidar with Orthogonal Po- 

e larization (CALIOP) and Cloud Profiling Radar (CPR). The matrix contains 
7 vertical profiles of cloud occurrence frequency as a function of the uppermost 
s cloud top. It is shown that the cloud fraction and uppermost cloud top ver- 

9 tical profiles can be related by a set of equations when the correlation dis- 

10 tance of cloud occurrence, which is interpreted as an effective cloud thick- 

11 ness, is introduced. The underlying assumption in establishing the above re- 

12 lation is that cloud overlap approaches the random overlap with increasing 

13 distance separating cloud layers and that the probability of deviating from 

14 the random overlap decreases exponentially with distance. One month of CALIPSO 

15 and CloudSat data support these assumptions. However, the correlation dis- 

1 6 tance sometimes becomes large, which might be an indication of precipita- 

17 tion. The cloud correlation distance is equivalent to the de-correlation dis- 

1 8 tance introduced by Hogan and Illingworth [ 2000 ] when cloud fractions of 

19 both layers in a two-cloud layer system are the same. 
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1. Introduction 

20 An accurate characterization of the vertical profiles of cloud properties for both singlc- 

21 layered and overlapping clouds is critical for calculating the radiative flux divergence 

22 within in and at the top of the atmosphere. For example, Barker et al. [ 2003 ] demon- 

23 strated that, for a given vertical distribution of liquid water content, changing the cloud 

24 overlap conditions can introduce errors in the zonal annual mean top-of-atmosphere 

25 (TOA) cloud radiative effect by up to 50 Wm“ 2 . Estimating the cloud base height accu- 

26 rately is important for surface radiation budget computations especially in polar regions. 

27 For example, simply changing the base height of an optically thick cloud from 5 km 

28 to 1 km increases the downward longwave irradiance by nearly 10 %. In addition to the 

29 importance of cloud overlap to radiation, cloud overlap affects precipitation parameteriza- 

30 tion in general circulation models (GCMs). If precipitation falls through clouds, collision 

31 and coalescence need to be considered but for precipitation falling through cloud-free air, 

32 evaporation needs to be considered [Jacob and Klein, 2000 ]. 

33 Multi-layer cloud information is not available from cloud retrievals by passive sensors ex- 

34 cept when a thin layer overlapping with optically thick warm clouds [Chang and Li, 2005 ]. 

35 In addition, undetected thin cirrus sometimes causes an error in cloud height retrieval if it 

36 overlaps with low-level clouds. In this case, a retrieval algorithm tends to place the cloud 

37 top in between the two cloud tops. Additionally, retrievals of total cloud water path tend 

38 to be biased when an ice cloud overlaps a liquid water cloud [Minnis et al., 2007 ]. New 

39 active sensors, however, are now providing multi-layer cloud information lacking in pre- 

40 vious satellite measurements. The Cloud-Aerosol Lidar and Infrared Pathfinder Satellite 
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4 1 Observation (CALIPSO) satellite and CloudSat provide detailed data on the vertical pro- 

42 file of clonds from the Tropics to polar regions. The CALIPSO Cloud-Aerosol Lidar with 

43 Orthogonal Polarization (CALIOP) and CloudSat Cloud Profiling Radar (CPR) identify 

44 multi-layered cloud top and base heights that are not easily detected with passive sensors. 

45 In earlier studies, Hogan and Illingworth [2000] derived cloud overlap statistics from 

46 ground-based radar data. They used the variable a that linearly combines the random 

47 and maximum cloud overlap. They assume that a decreases exponentially as the separa- 

48 tion between two cloud layers increases and define the e-folding distance (or de-correlation 

49 distance). Wang and Dessler [2006] used 20 days of Ice, Cloud, and land Elevation Satel- 

50 lite (ICESat) data over the Tropics to show that 1/3 of boundary layer clouds overlap 

51 nearly randomly with cirrus clouds. Mace and Benson-Troth [2002] extended the work 

52 of Hogan and Illingworth [2000] and derived seasonal and regional variations of a and its 

53 e-folding length using ground-based Atmospheric Radiation Measurement (ARM) radar 

54 data taken at 4 different sites. Barker [2008b] derived a from 2 months of CPR and 

55 CALIOP combined data and found that, over Southern Great Plains (SGP) ARM site, 

56 the de-correlation distance is consistent with that reported by Mace and Benson-Troth 

57 [ 2002 ], 

58 A first step in using multi-layer cloud information from CALIOP and CPR is to merge 

59 cloud vertical profiles (hereinafter merged cloud profiles) derived independently from two 

60 instruments. Cloud profiles from either CALIPSO or CloudSat alone are not enough to 

6 1 provide a complete picture of cloud vertical profiles; The CPR tends to miss thin clouds 

62 composed of small cloud particles (the minimum detection is -30 dBZ, Stephens et al. 

63 [ 2008]) and CALIOP signal is attenuated by optically thick clouds (optical thickness 
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64 greater than about 3 ). Section 2 discusses our method of merging cloud profiles derived 
ea from CALIOP and CPR, 

66 Once cloud profiles from the two instruments are merged, the impact of cloud structures 
6? on the irradiance profiles can be assessed by comparing the irradiances computed with 

68 merged cloud profiles to those computed using simple single-layer clouds, which are the 

69 typical products retrieved from passive sensor measurements. For this reason, we will 

70 further collocate merged cloud profiles with footprints of the Clouds and the Earth’s 
?! Radiant Energy System (CERES) instrument on Aqua. In addition, radiative effects at 

72 the surface and in the atmosphere are evaluated when irradiance vertical profiles are 

73 computed by a radiative transfer model using merged cloud vertical profiles. Aiming 

74 toward this goal, we keep cloud information at the original CALIOP and CPR resolutions 

75 as much as possible while collocating and merging them into CERES footprints so that the 

76 independent column approximation can be properly applied in computing the irradiance 

77 profile. One purpose of this paper is to describe the process to merge CALIOP and 

78 CPR derived cloud profiles within a CERES footprint. Although this study does not 

79 use the result of collocation of cloud profiles with CERES footprints and CERES-derived 
so irradiances, this paper includes descriptions of the process in the Appendix A because the 
si process is interwoven with the CALIOP and CPR cloud profile merging process. 

so The main purpose of this paper is to describe a tool to quantitatively analyze cloud 
as vertical profiles in order to assess their impact on radiation. Our approach to quantita- 

84 tivcly evaluate vertical cloud profiles and overlap is different that introduced by Hogan 

85 and Illingworth [ 2000 ]. We sort merged cloud profiles and form a simple cloud frequency 

86 of occurrence matrix. The matrix leads to a set of equations that relates the cloud frac- 
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a? tion exposed to space, cloud fraction vertical profile and cloud physical thickness. For a 
as two-layer cloud system under a certain condition, the de-correlation length introduced by 

89 Hogan and Illingworth [2000] can be related to the cloud effective thickness. The relation 

90 between cloud fraction, topmost cloud top vertical profiles, and cloud thickness, therefore, 

91 provides a physical interpretation of the de-correlation length, a parameter that appears 

92 somewhat unique to GCMs. In this paper, we only treat correlations of cloud mask and 

93 did not consider correlation of liquid or ice water content as done by Hogan and Illingworth 

94 [2003], 

95 Section 2 describes the process combining CALIOP and CPR derived cloud profiles, 

96 Section 3 introduces the cloud frequency of occurrence matrix, derives a set of equations 

97 relating the cloud occurrence, uppermost cloud top, and cloud thickness, and discusses 

98 the relation of our approach to the concept introduced by Hogan and Illingworth [2000]. 

2. CALIPSO and CloudSat combined cloud profile 

99 The CALIPSO program provides the Vertical Feature Mask (VFM), which defines clouds 

100 and aerosols at a , 0.333-km horizontal resolution below 8.2 km altitude and a 1-km 

101 horizontal resolution above 8.2 km [ Winker et al, 2007]. The CloudSat CLDCLASS 

102 data provide information on clouds at a 1.4-krn cross-track horizontal resolution and at 

103 a range, or vertical, resolution of 480 m Stephens et al. [2008]. To take advantage of 

104 both the CALIOP and CPR instruments, first, the VFM and CLDCLASS profiles are 

105 collocated using 1-km x 1-km grids. Second, the combined cloud profiles are collocated 
ioo with CERES footprints, which are approximately 20 km in size. Note that the actual 
107 point spread function of the CERES instruments is approximately 35 km in size because 
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108 the response time causes a widening and skewing the point spread function [Smith, 1994 ], 
loo Third, based on the cloud top and base heights, the cloud profiles that fall within a 
no CERES instrument footprint are grouped together in the following way. 
in Every 1 -krn by 1 -km grid box contains one CloudSat and three VFM vertical profiles, 
no Each CALIPSO-derived cloud profile is compared with a collocated CloudSat-derived 
in cloud profile to combine the information. The cloud top and base heights for the grid 
n 4 box are determined using the strategy described in Table 1 . Because the CloudSat range 
ns resolution is greater than CALIPSOs, the CALIOP and CPR derived cloud boundaries 
lie need to differ more than 480 m to be considered as distinctly different boundaries. The 
n 7 merged cloud profiles are primarily based on CALIOP derived cloud profiles, except when 
ns the signal is completely attenuated. About 85 % of cloud tops and 77% of cloud bases 
n 9 of merged profiles are derived from CALIOP data. When the CPR identifies a cloud 

120 boundary that is more than 480 m away from CALIOP-derived cloud boundary, the 

121 cloud boundary is inserted to the CALIOP derived cloud profile. Cloud bases are from 

122 CALIOP data (Table 1 ) to avoid the influence of precipitation. In a a very few cases, 

123 CALIOP did not detect clouds in the height range between CPR-detected cloud top and 

124 base. A CPR-detected cloud layer is then inserted for this case. 

125 We determined the maximum number of groups allowed within a CERES footprint is 16 

126 and the maximum number of layers allowed within a group is 6 after reviewing statistics 

127 of the number of unique cloud groups within a footprint and cloud layers in the profile. 

128 For the cases when the number of unique groups exceeded sixteen, the process explained 

129 in Appendix C was adopted to combine profiles with nearly the same cloud top and base 

130 heights. Those grouped cloud profiles are used in this study. Because this cloud grouping 
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131 process only change the order of occurrence of cloud profiles within approximately 35 km, 

132 imposing the size of CERES footprint as a domain to form cloud groups does not degrade 

133 the original cloud vertical profile information observed by CALIOP and CPR, except for 

134 profiles that exceed the limit of 16 groups within the domain. 

3. Cloud Frequency of Occurrence Matrix 

To form a cloud frequency of occurrence matrix, we sort merged cloud vertical profiles 
explained in the previous section by the uppermost cloud top height z top with the bin size 
of 200 m and count the number of cloud occurrence below the uppermost cloud top. This 
process produces a 2D histogram of cloud occurrence of which columns are separated by 
the highest cloud top z top and rows contain the vertical profile of cloud occurrence for a 
given uppermost cloud top. The element defined by the ith column and jth row, therefore, 
contains the number of cloud occurrences in the jth layer when the uppermost cloud top 
height is at the ith layer Zt op ,i ■ When the number of counts in the jth row and ith column 
is rij t , the probability of cloud occurrence in the jth layer with the uppermost cloud top 
at the ith level is 

P{ z j, ^to P ,i) Hjj/iV,. (1) 

where N is the total number of profiles, including cloud-free profiles. The cloud layer 
index starts from the surface and increases with altitude so that 

riji > 0 when j < i, and nji = 0, when j > i. (2) 

Therefore, the cloud frequency of occurrence matrix is a lower triangular matrix. It is 
different from the cloud overlap matrix defined by Willen et al. (2005) in which elements 
are cloud fraction exposed to space by a two-cloud layer system. The uppermost cloud 
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layers, which are the diagonal elements of the cloud occurrence frequency matrix, are the 
clouds exposed to space. The probability of the cloud occurrence in the ith uppermost 
layer is P(zi, z top ,i )■ The sum of all of the uppermost cloud layers computed over a region 
over a given period defines the mean cloud fraction 


V m n - m 

c=^^=f:p(z i ,z top , i ), 


N 


( 3 ) 


i= 1 


where m is the total number of vertical layers. The conditional probability that clouds 
are present in the jth layer when the uppermost cloud top height is z toPti is 

P(^j i Ztop,i) 


P(/^j | % top,i ) 


P(Zi^ Z t 0 p,i ) 


( 4 ) 


and P(zi\z top ,i) = 1. The frequency of cloud occurrence in the jth layer with any uppermost 
cloud top heights (i.e. the probability of cloud occurrence in the jth layer regardless of 
cloud occurrence above) is 


y ~'m m 

p(z j ) = = y P( 2 ,, z topi ). (5) 

i=j 

135 Note that the probability of cloud occurrence depends on the vertical depth of the bin 
ns (Appendix A). In this study, we use a bin that is sufficiently smaller than the thickness 

137 of cloud. 

With the above definitions, the random overlap probability of a cloud in the jth layer 
and ith layer is P Zj P Zi . The random overlap probability between clouds at the jth layer 
and a uppermost cloud top layer at z top ,i is P(zj)P(zi, z top ,i)- The conditional probability 
of random overlap of jth layer clouds with an uppermost cloud top is at z top ^ is, therefore, 


Prdm(Zj\Ztop t i) P {Zj'j P {Zj z Zi fy pjj / P (Zj z Zf i(l pjj I J (Zj 


( 6 ) 
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We further divide the conditional probability p{zj\z top ,i) into two terms, 


P ( Zj | Ztop,i ) 


P(Zj) Ztop,i 
P(Z'i’) %top,i 


P rdm ( Zj | Ztop,i ) T ^P{Zj \ Zt Q p,i ) •> 


(7) 


where Prdm{zj\z t0 p,i) is the probability of random overlap defined by (6), and A P is the 
deviation from the random overlap. Therefore, 


When j = i, 


^P(Zj | Zt 0 p^i ) 


P{Zj, Zfop^i 
P(Zi, Zt 0 p^i 


- P{zj 


AP(zi\z toP:i ) = 1 - P(zi). 


( 8 ) 


(9) 


Similar to the assumption made in earlier studies (e.g. Hogan and Illingworth [2000]), 
when i < j, we assume that A P decreases exponentially with distance, 


A P(zj\ztop,i) ~ [1 - P(zi)] exp(-A Zji/Di), (10) 

us where Az Jl is the distance from the ith uppermost cloud top to the ith layer, z t0P)i — Zj , and 
139 D is the e-folding distance or correlation length of cloud occurrence, namely the vertical 
i« distance that the probability of cloud occurrence that deviates from the random overlap 

141 diminishes by a factor of e. Note that the subscript of D indicates that the correlation 

142 length is a function of the uppermost cloud top height. 

143 When A^ = 0 and (10) is substitute in to (7), we recover P(zi\z top ,i) = 1, provided 

144 Prdm(zi\z t o P ,i) = P(zi). The conditional probability of overlap with itself is 1. Therefore 

145 1 — P(zi) in (10) is the conditional probability of the ith layer cloud overlapping the ith 
«6 layer uppermost cloud top that deviates from the random overlap. If there is no physical 
147 process connecting two layers, we would expect that the clouds in those two layers overlap 
us randomly. Therefore, the e-folding distance Di can be interpreted as the distance over 
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us which the physical process of cloud formation falls off by a factor of e or simply the 

150 effective thickness of cloud. 

151 Equation (a 5 ) in Appendix A suggests that the necessary condition to establish the 

152 relation of exponential decay is a smaller vertical bin size compared with D. For simplicity, 

153 we fix the bin size to 200 m throughout the atmosphere in this study. Our bin size exceeds 

154 the 90 m used by earlier study used Mace and Benson- Troth [ 2002 ], When D is the effective 

155 thickness of clouds, D derived from data does not depend on the bin size as long as the 

156 bin size is smaller than D. 

Given the uppermost layer at the ith layer, probability of cloud occurrence at the jth 
layer is, therefore, 

P(zj\z top ,i ) = P(zj) + [1 - P(zi)] exp[— (yj - Zj)/Dj\. ( 11 ) 

The cloud occurrence in the jth layer is, therefore, obtained by multiplying ( 11 ) by 
P(zi , z top ,i ) and summing all uppermost cloud top layers above the jth layer, 

m m 

P(zj)[ 1- J2 P(zi,z toPti )] = P(zj,z toPtj ) + J2 P(zi,z top ,i)[l - P(zi)]e~( Zi ~ Zj)/Di , (12) 
i=j + 1 i=j + 1 

where m is the highest cloud layer detected by CALIOP and CPR (See Appendix B for 
the derivation). When we obtain ( 12 ) for all layers, they can be expressed as a matrix 
operation 

P = DT, ( 13 ) 

where 

P = [P(z 1 ),P(z 2 )---P(z m )} T , ( 14 ) 

T [P(^l, Zt op ^ i), P(^2) ^top, 2 ) ' ' ‘ P(Zni £fop,n)] , (1^) 

D = 
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/ 

1 

z 2~ z l 

\l-P(Z 2 )]e 

z m — 1 Z 1 

[1-P( 2m _i)]e D ra-X 

z m~ z 1 

[l-P(Zm)le 

\ 

1- 

2 P ( z i> z top,i) 

1 — ^2i = 2 P( z ii z top,i) 

1 — P( Z ii Z top,i) 

1 — P( z ii z top,i) 





z m — l — 2 2 

z m ~ z 2 



0 

1 

[1-P(z m _i)]e "“- 1 

[1-P(z m )]e °m 



— o P( z i> z top,i) 

1 — P(Zi,Ztop,i) 

1 — P( z i, z top,i) 






z m~ z n—l 



0 

0 

1 

[1-P(z m )]e D m 



1_ X)i=„-l P ( z i> z top,i) 

1 — n _i P{ z ii z top,i) 


V 

0 

0 

0 

1 

) 


(16) 

and super script T denotes the transpose of the matrix. In (14), (15), and (16), m is the 
number of cloud layers, n is the number of uppermost cloud layer, and n = m. Equation 
(13) relates the cloud fraction profile, the uppermost cloud top profile (i.e. the cloud 
fraction exposed to space) and cloud effective thickness. The matrix D that relates cloud 
fraction and uppermost cloud top profiles contains both unknowns but since it is an upper 
triangular matrix, if either the cloud fraction or the uppermost cloud top vertical profile 
is known, it can be solved for the other unknown profile provided the correlation length is 
known. To solve the set of equations, we need to start from the highest layer by setting, 


Pi^Zmi 


Ztop,m ) — P(Zm)- 


(17) 


is? Therefore, if the cloud vertical correlation length as a function of uppermost cloud top 
us height is known, vertical cloud fraction and uppermost cloud top profile can be related. 
In earlier studies ( Hogan and Illingworth [2000]; Bergman and Rasch [2002]; Barker 
[2008]) the cloud fraction exposed to space for a two-cloud layer system is written as 

I ’ k! P'rdm. D {Crd.rn C max ) , (18) 


where C r( i m and C max are, respectively, the cloud fraction given by the random and max- 
imum overlap assumptions. This can be written with the notation used here as 


C k i = P(zi) + P(z k ) - P{z k )P(zi) - aP(zi) 


min[P(z k ),P(zi )] 

P{*i) 


- P(z k ) 


(19) 
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159 where the layer l is the upper layer, min[P(z k ), P(zi)\ is equal to the smaller value between 

~ z k-n 

wo P(z k ) and P(zi) and a = e Az o . 

For a two-cloud layer system, the cloud fraction in two cloud layers, k and /, using the 
correlation length is the sum of cloud fractions in the upper and lower layers, 

C kl = P ( Zl ) + P(z k ) - P(z k )P( Zl ) - P( Zl )[ 1 - P(^)]e““- (20) 

lei The last term on the right side in both (19) and (20) reduce the cloud fraction exposed 

162 to space from that given by the random overlap assumption. Cloud fractions exposed to 

163 space computed by (19) and (20) differ for an arbitrary set of two-layer cloud fractions 
when the distance between two layers is small. The cloud fractions given by (19) and (20) 

165 are equal when P(zi) = P(z k ). Therefore, when a = e~^ Zl ~ Zk ^! Az ° , our correlation length 

166 of D is equivalent to the de-correlation length Az 0 when P(z k ) = P(zi). Note that even 
le? when the distance between the two layers approaches zero, C k i by (20) does not approach 
lea the upper layer cloud fraction unless the cloud fraction in the upper and lower layers are 

169 the same. We expect that the cloud fraction difference in upper and lower layer is small 

170 when the distance between the cloud layer is small and the difference approaches zero as 

171 the distance decreases because of the finite thickness of clouds. 

4. Results and Discussion 

172 Figures 1 and 2 show, respectively, the vertical profile of cloud fraction P(z) and 

173 AP(z\z top ) in (7) derived from 1 month of data (July 2006) taken over 6 different re- 

174 gions. AP(z\z top ) decreases monotonically with the distance from the uppermost cloud 

175 top for a given uppermost cloud top height. When the distance is large, it sometimes 

176 is negative in the southern hemisphere tropics. One possible reason for this is that the 
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177 CALIOP signal is sometimes completely attenuated while the CPR misses low-level clouds 
m so that low-level clouds occur less often than random overlap when mid and high level 

179 clouds are present. Note that a large cloud fraction above the tropopause over the Antarc- 

180 tic is in the original CALIPSO VMF data product and results for two reasons (D. Winker 
isi personal communication 2009 ). First, it is sometimes difficult to identify the exact height 
iso of tropopause over the Antarctica, and second, clouds that extend from the troposphere 
i 83 into stratosphere are included in VFM data. 

isi The assumption made in the previous section in deriving ( 12 ) is that A P in ( 7 ) decreases 
i 85 exponentially with distance from the uppermost cloud top. Figure 3 shows A P as a 
we function of the distance from the uppermost cloud top for selected uppermost cloud top 
is? heights. It indicates that A P decreases nearly exponentially with distance from the 

188 uppermost cloud top for intermediate distance. A large correlation distance, hence a 

1 89 smaller slope such as the 8.9 km case at the greater than 4 km from the uppermost cloud 
wo top on the left side plot of Figure 3 , might be an indication of precipitation. A small slope 

191 near the cloud top might be caused by the finite thickness of clouds i.e. existence of a 

192 minimum cloud thickness. 

193 Because the inverse of the slopes of the lines shown in Figure 3 is the correlation 

194 distance, the correlation distance as a function of the uppermost cloud top height can 

195 be derived by a linear regression. However, Figure 3 indicates that the slope is not 
we constant throughout the atmospheric column for a given uppermost cloud top. Therefore, 
197 applying a linear regression to the uppermost cloud top to the surface can leads to a biased 
us estimate. To reduce the error, we compute the slope using a 1 . 2 -km moving window and 
199 average all slopes so that a constant slope extending over the largest vertical length is 
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200 given the greatest weight. The result is plotted on Figure 4. As expected, the correlation 

201 distance, which is the effective cloud thickness, increases with uppermost cloud top height. 

202 When the uppermost cloud top height is larger than about 8 km, the correlation distance 

203 becomes nearly constant and does not increase with height. This might be caused by 

204 frequently occurring thin cirrus. The correlation length in the Tropics does not differ from 

205 midlatitude values, probably because thick convective clouds does not occur frequently 

206 even in the tropics compared with the occurrence of other cloud types [ Dong et al. 2008]. 
20? The correlation distance derived here is related to the de-correlation length introduced 

208 by Hogan and Illingworth [2000] as indicated by (19) and (20). Those are not exactly the 

209 same but the de-correlation distance, property which appears unique to GCMs, coincides 

210 with the correlation distance of clouds defined in this paper when the cloud fraction of two 
on layers in the system are equal. Therefore, this result provides a physical interpretation of 

212 the de-correlation distance, which might give some insight into how it is derived and how it 

213 can be approximated when it is applied. Barker [2008a] speculates that the de-correlation 

214 length depends on altitude. Because the above result indicates that the de-correlation 

215 length is related to the effective cloud thickness and clearly the cloud thickness depends 

216 on cloud type, we expect that the de-correlation length also depends on height. 

217 The height dependence of the de-correlation distance is sometimes neglected when pa- 

218 rameterizing the cloud overlap [ Barker 2008a, Barker and Paisanen 2005]. The error in 

219 the zonal and monthly mean TOA shortwave irradiance caused by neglecting the height 

220 dependence of the de-correlation distance in computing the TOA shortwave irradiance is 

221 less than 3 Wm“ 2 [Barker 2008a]. If the difference between the de-correlation distance 

222 and the correlation distance gives a smaller TOA irradiance change compared with the 
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223 TOA irradiance change caused by neglecting height dependence of the de-correlation dis- 

224 tance, the cloud correlation distance introduced here might be used as the de-correlation 

225 distance for a cloud overlap parameterization. 

To obtain a rough estimate of the sensitivity of the TOA reflected shortwave irradiance 
to the correlation distance, we use (12) and take a derivative with respect to D , 

= - Z ^P(z l ,z tapl )[\ - P(z,)\e-^' D ‘, (21) 

226 where the layer / is the upper layer. The actual cloud fraction in a layer depends on the 

227 vertical depth of the layer, but Figure 1 suggests that P(zi, z top ,i ) = P(zi) ~ 0.25 can 

228 be used as a rough estimate. If we further assume that A = 2 km, and zi — Zk = 2 

229 km, a 0.5 km error in A gives about a 0.1 cloud fraction error in P(z fc , z top ^)- If we use 

230 a typical value of ~ — 40Wm -2 for a zonal mean TOA shortwave cloud forcing in the 

231 Tropics and 0.6 for a zonal mean cloud fraction exposed to space (e.g. Kato et al. [2008]), 

232 a 0.1 cloud fraction change gives about 7 Wm -2 difference at TOA. Therefore, a rough 

233 estimated tolerance of the correlation distance that gives an equivalent TOA shortwave 

234 change by neglecting height dependence of de-correlation length is about 0.4 km. Figure 

235 4 shows that the variability of the correlation distance among for uppermost cloud top 

236 heights that are within « 1 km of each other is on the order of 0.5 km. We expected 

237 that the 0.1 cloud fraction change is the upper bound, hence this tolerance value would 

238 be an underestimate for the following reason. Using A = Zi — z in the estimate gives the 

239 largest cloud fraction change because a maximum of the function Zl ~2 k e~^ Zl ~ Zk ^ Dl occurs 

240 when zi — Zk = Di. In addition, the the correlation distance varies with height more than 

241 that caused by the uppermost cloud top variation within « 1 km (Figure 4), which is also 

242 an indication that neglecting height dependence has a larger effect on TOA irradiances. 
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243 Earlier studies indicate that the variability of TOA shortwave irradiance is mostly 

244 caused by the variability of the cloud fraction exposed to space [ Loeb et al. 2007 ]. The 

245 relationship among the uppermost cloud top, correlation distance, and cloud fraction sug- 

246 gests that the cloud fraction exposed to space changes by the correlation length and the 

247 cloud fraction in the vertical layers. In the above two-layer system, the effective cloud 

248 thickness Di determines whether the fraction of clouds in the k layer vertically extends 

249 from the / layer or the clouds exposed to space to become the uppermost cloud layer k. 

250 The sensitivity of the cloud fraction expose to the space to the correlation distance is 

251 largest when the k and / layers are separated by the distance Di. 

252 Earlier studies (e.g. Barker et al. [ 2003 ]) indicate that the cloud fraction exposed to 

253 space largely depends on the assumed type of cloud overlap. Whether switching from the 

254 random to the maximum cloud overlap assumption can lead to a significant improvement 

255 in the TOA shortwave irradiance depends on the error in the correlation length and cloud 

256 fraction in the vertical layers. If errors in the correlation length and the cloud fraction in 

257 vertical layers are large, adopting a proper cloud overlap assumption may not significantly 

258 improve TOA irradiance estimates. The change in the cloud fraction exposed to space due 

259 to changing to the maximum/random cloud overlap assumption from the random cloud 

~H~ z k 

260 overlap assumption in a two cloud layer system is A P(zk, z top ,i ) = P(zi)[ 1 — P(zi)\e D k . 

261 This term is greater than the change in the cloud fraction exposed to space caused by the 

262 error in the correlation length if z '~2 3 A D,j is less than unity, which is possible as long as 

i 

263 the error in the correlation distance does not exceed 100 % near the cloud base. Similar to 

264 the above two-cloud layer example, if we use P(zi) = 0.25 and Di — zi~ Zk, the change in 
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265 the cloud fraction exposed to space due to changing the overlap assumption A P(z fc , z top ,i) 

266 is 0 . 19 . 

The sensitivity of the cloud fraction exposed to space clue to the error in the cloud 
fraction is 


d/Tfe, ■’ _ . _ y ' p/ , 

dp(z t ) _1 iA. 


( 22 ) 


26? The second term on the right side is the cloud fraction exposed to space above the fcth 

~H~ z k 

268 layer. Comparing ( 22 ) with A P(zk,z top j) = P(zi)[ 1 — P(zi)\e D k , if the cloud fraction 

269 error in the kth layer is smaller than the upper-layer cloud fraction in a two layer system, 

270 the error in the cloud fraction exposed to space due to the error in the cloud fraction 

27 1 is smaller than A P(z,z top ). Therefore, the improvement of the TOA irradiance estimate 

272 caused by adopting a proper cloud overlap parameterization is large if the upper layer 

273 cloud fraction is large. 


5. Summaries and Conclusions 

274 We combined vertical cloud profile from CALIPSO and CloudSat to utilize the strength 

275 of each instrument and to understand vertical cloud profile quantitatively. We introduced 

276 the cloud frequency of occurrence matrix that contains the vertical cloud profile as a 

277 function of uppermost cloud top. When we assume that the cloud overlap approaches 

278 the random overlap as the distance between the two cloud layers increases and define the 

279 e-folding distance of the cloud occurrence probability deviating from the random overlap, 

280 the uppermost cloud top and the cloud fraction vertical profiles can be related. The 

281 e-folding distance, or correlation distance, is interpreted as the effective cloud thickness. 

282 Cloud vertical profiles derived from CALIOP and CPR shows that the cloud occurrence in 
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283 layers below the uppermost cloud layer deviating from the random overlap nearly decays 

284 exponentially. However, the data show that the correlation distance is not necessarily 

285 constant throughout the atmospheric column for a given uppermost cloud top height. A 

286 large correlation distance might be an indication of precipitation and the change of the 
28 ? correlation distance might be used to screen precipitation. 

288 In a two-cloud layer system, the correlation distance is equivalent to the de-correlation 

289 distance introduced by Hogan and Illingworth [2003] when the upper and lower cloud 

290 fractions are the same. Therefore, the de-correlation distance, which appears to be a 

291 parameter somewhat unique to general circulation models, is linked to the effective cloud 

292 thickness. 


Appendix A: The effect of the vertical bin size 

If we assume the conditional probability of cloud occurrence decreases exponentially with 
the distance from the uppermost cloud top 

p(zj\z top j) = e ~ Zji/Di , (al) 


where p(zj\z toPti ) is the probability of cloud occurrence in a thin layer and z 3i = Zi — Zj. 
The mean probability of cloud occurrence in the uppermost layer of A thickness is 




rAz.: 


A Zi 


*!D tiz = A(1 - e~ Az ‘ /D| ) 
Az, 


(o.2) 


When Azi/ Di <C 1, P(zj\z top ,i) ~ 1. The mean probability of cloud occurrence in the jth 
layer of which thickness is A Zj and z 3i distance from the uppermost cloud top layer i is 


| %top,i) 


f-Zji+Azj/2 


J Zji—Azj /2 


e-*' Di dz = 


D:e D i I e 2D i — e 


Az; 


(o3) 
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The conditional probability then becomes 


i i 

A z;e D e to — e 2D i 


P{ z j\ z top,i ) 

P(zi\ztop,i) Azjll-e^i 


When Azj/D <C 1 , the conditional probability is 


P {Zj | Ztop, 
P \Ztops 


1 ) p Z ji/ Dj, 


(a 4 ) 


(a 5 ) 


Appendix B: The relation between cloud fraction and uppermost cloud top 
profiles 

The conditional probability of the cloud occurrence in the jth layer given the uppermost 
cloud top is in the ith layer is the sum of the probability due to a random overlap and a 
maximum overlap, 

PdjlztopZ = P[zj ) + [1 - P(zj)\ exp [-(Zi - Zj)/Dj\. ( 61 ) 

Because P(z j \z toPti )P(z i , z top Z = P(zj, z toPji ) and E ? =j p { z j, z to P ,i) = P(zj), when we mul- 
tiply (bl) by P(zi, Zto P ,i ) and sum up from i — j to m, then 

m m 

P(zj) = z top,i)P( z j ) + y P (a, z top ,i)[ 1 - p ( z i)\ ex P H(a - Zj)/Di\. ( 52 ) 

i=j i=j 

294 This expression leads to ( 14 ). 

Appendix C: Cloud merging and grouping process 

295 The CALIPSO and CloudSat cloud masks, obtained from the VFM and CLDCLASS 

296 products, respectively are independent and sometimes can differ significantly due to char- 

297 aeteristics of the instrument used. This allows three combinations when the CALIPSO 
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298 and CloudSat masks are paired: 1 ) CALIPSO is cloud-free in the column and CloudSat 

299 reports clouds, 2 ) CALIPSO reports clouds and CloudSat is cloud-free in the column, and 

300 3 ) both CALIPSO and CloudSat report clouds somewhere in the column. If only one of 

301 the paired profiles is valid, the valid profile is used without altering the profile. 

302 After identifying the three cloud mask combinations described above, the cloud masks 

303 are compared at each vertical layers from each instrument. The vertical resolution of 

304 CALIPSO profile is 30 m below the altitude of 8 km and 60 m above the altitude of 8 

305 km [ Winker et al. 2007 ]. The vertical resolution of CloudSat profile is 240 m throughout 

306 [ Stephens et al. 2008 ]. Comparing the cloud masks layer by layer, identical profiles 
so? are grouped. Where both the CALIPSO and CloudSat profiles are cloudy, all CALIPSO 

308 profiles match and all CloudSat profiles match for it to be grouped together. If the number 

309 of resulting groups is less than 16 , all groups are kept. If that number is exceeded, similar, 

310 less populous profiles are combined together until the number becomes less than or equal 
3n to 16 . 

The process to reduce the number of cloud groups when it exceeds 16 is as follows. 
First, the number of unique profiles within a case, CALIPSO cloudy CloudSat cloud- 
free profiles, CALIPSO cloud-free CloudSat cloudy profiles, and CALIPSO and CloudSat 
cloudy profiles, is determined by 


/ 3 , N 3 16 

ri: = 16 n r o r, 


(cl) 


312 where N is the number of profiles in the case, n is the number of unique profiles in the 

313 case (i.e. N > n) and superscript i and /, respectively, indicate the initial and final. If 

314 the number of unique profiles in the case is within the limit, no combining is done for 

315 the case. If the limit is exceeded, all unique profiles that contain nine or more matches 
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sis are kept. Then starting with the remaining profile with the most exact matches, other 
si? profiles that only differ by one are combined with it. If this fails to reduce the number 
sis of profiles below the limit, the last step is repeated combining profiles that differ by an 

319 increasing number of layers until the limit is met. 

320 The number of cloud profiles in a CERES footprint is sometimes nearly 50 (Figure 5). 

321 This cloud grouping process reduces the number of profiles to less than or equal to 16. 

322 The area covered by different cloud profiles grouped together is less than 10% for most 

323 of CERES footprints. As a result, the cloud profiles are not altered very much from the 

324 original CALIOP and CPR cloud profiles (Figure 6). The number of vertical layers in 

325 a profile before the algorithm reduces it to the maximum of 6 is less than 6 for most of 

326 merged profiles (Figure 7). 99.68 
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Table 1 . Cloud mask merging strategy 


Cloud boundary 

CALIOP 

CPR 

Merged boundary 

Top 

Detected 

Detected 

Higher cloud top 

Top 

Detected 

Undetected 

CALIOP cloud top 

Top 

Undetected 

Detected 

CPR cloud top 

Base 

Not completely attenuated 

Undetected 

CALIOP cloud base 

Base 

Not completely attenuated 

Detected 

CALIOP cloud base 

Base 

Completely attenuated 

Detected 

CPR cloud base 

Base 

Completely attenuated 

Undetected 

CALIOP lowest unattenuated base 




Figure 1 . Cloud faction vertical profile derived from CALIPO and CPR merged cloud profiles 
computed with 200 m resolution for July 2006. left) northern hemisphere and right) southern 
hemisphere. 
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Topmost cloud top height (hPa) 
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Topmost cloud top height (hPa) 
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Topmost cloud top height (hPa) 

Figure 2. Deviation from the random overlap 
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Topmost cloud top height (hPa) 
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Topmost cloud top height (hPa) 
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Topmost cloud top height (hPa) 


A P defined in (9) as a function of uppermost 


cloud top height for 6 different regions. Cloud vertical profiles derived from July 2006 CALIOP 


and CPR data are used. 
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Figure 3. Deviation from the random overlap A P as a function of distance from the uppermost 


cloud top for three uppermost cloud top heights. 


DRAFT 


April 17, 2009, 11:33am 


DRAFT 


X - 28 


KATO ET AL.: CLOUD OCCURRENCE, OVERLAP, AND THICKNESS 


90° N - 60° N 


60° S - 90° S 



0 3 6 9 12 15 


0 3 6 9 12 15 


Topmost cloud top height (km) 


Topmost cloud top height (km) 


60° N - 30° N 


30° S - 60° S 



0 3 6 9 12 15 


0 3 6 9 12 15 


Topmost cloud top height (km) 


Topmost cloud top height (km) 


30° N - 0° N 


0° S - 30° S 



0 3 6 9 12 15 


0 3 6 9 12 15 


Figure 4. 


Topmost cloud top height (km) Topmost cloud top height (km) 

Correlation length derived from one month (July 2006) of CALIOP and CPR of 


data as a function of uppermost cloud top height for 6 different regions. 
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Figure 5. Left) Cumulative distribution of the number of cloud groups in a CERES footprint. 
The blue line indicates the actual number of profile cumulative distribution and the red line 
indicates the cumulative distribution after reducing to the maximum of 16 groups in a footprint. 
Right) Cloud fraction of cloud groups greater than or equal to the 11 th cloud group number. 
The cloud group number having the largest cloud fraction over a footprint is 1 and the largest 
cloud number is assigned to the cloud group having he smallest cloud fraction. 
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Latitude Latitude 




Figure 6. a) Cloud fraction exposed to space as a function of latitude derived from CALIPSO- 
CloudSat merged cloud profile before grouping (solid line) and after grouping (dash-dot line). 
The difference (after grouping minus before grouping) of the zonal mean cloud fraction exposed 
to space b), the difference in the cloud fraction vertical profile c), and uppermost cloud top 
fraction vertical profile d). 
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Figure 7. Cumulative occurrence of the number of vertical cloud layers in a CALIPSO- 
CloudSat merged cloud profile. 
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